Customized head-mounted display device

ABSTRACT

A head-mounted display device includes a modular frame assembly including one or more different components. Each of the different components may be selected from a component set including at least two or more differently-sized versions of each different component. The head-mounted display device also includes a modular see-through display sub-assembly including one or more mountings for selectably coupling the modular see-through display sub-assembly to the modular frame assembly. The modular see-through display sub-assembly may be configured to couple to any combination of differently-sized versions of different components of the modular frame assembly.

BACKGROUND

Some augmented reality devices may display virtual objects viasee-through displays. Because such augmented reality devices overlay thevirtual images on real objects in a user's field of view, the displaydevices need to be precisely aligned with the user's eyes to deliveraccurate images and prevent user discomfort. However, given that eyesize and location, head size, and other facial features vary widely fromuser to user, these display devices lose accuracy when assembledaccording to a “one-size fits most” approach.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter. Furthermore,the claimed subject matter is not limited to implementations that solveany or all disadvantages noted in any part of this disclosure.

Embodiments for a customized head-mounted display device are provided.In one example embodiment, a head-mounted display device includes amodular frame assembly including one or more different components. Eachof the different components may be selected from a component setincluding at least two or more differently-sized versions of eachdifferent component. The head-mounted display device also includes amodular see-through display sub-assembly including one or more mountingsfor selectably coupling the modular see-through display sub-assembly tothe modular frame assembly. The modular see-through display sub-assemblymay be configured to couple to any combination of differently-sizedversions of different components of the modular frame assembly.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 schematically shows an example head-mounted display deviceaccording to an embodiment of the present disclosure.

FIG. 2 is a flow chart illustrating a method for creating a customizedhead-mounted display device according to an embodiment of the presentdisclosure.

FIG. 3 is a flow chart illustrating a method for obtaining a user fitprofile according to an embodiment of the present disclosure.

FIGS. 4A-4C schematically show an example user fit profile.

FIG. 5 schematically shows an example mechanism for manually measuring auser's fit points.

FIG. 6 is a flow chart illustrating a method for obtaining a user fitprofile according to another embodiment of the present disclosure.

FIG. 7 schematically shows an example user scanning system.

FIG. 8 is a flow chart illustrating a method for assembling a modularhead-mounted display device according to an embodiment of the presentdisclosure.

FIGS. 9A and 9B schematically show example modular component setsaccording to an embodiment of the present disclosure.

FIG. 10 schematically shows an example menu of modular components forassembling a head-mounted display device according to an embodiment ofthe present disclosure.

FIG. 11 schematically shows an example head-mounted display deviceassembled from the menu of FIG. 10.

FIG. 12 is a flow chart illustrating a high-volume method of assemblinga customized head-mounted display devices according to an embodiment ofthe present disclosure.

FIGS. 13-15 schematically show example customized frames according toembodiments of the present disclosure.

FIG. 16 schematically shows a non-limiting example of a computingsystem.

DETAILED DESCRIPTION

Head-mounted display (HMD) devices in accordance with the presentdisclosure are configured to present images on a see-through display inorder to provide an augmented reality experience for a user. Because theaugmented reality experience does not block out real objects in theuser's field of view, HMD devices may be designed to precisely align thesee-through display with the user's eyes in order to align virtualimages with real objects. Further, the frames of the HMD device on whichthe see-through display is mounted may be configured to maintain thesee-through display in a desired position, regardless of movement of theuser's head.

To provide a desired fit for each user, each HMD device may becustomized to accommodate fit points of a respective user. The fitpoints of the user as well as an interpupillary distance of the user maybe obtained prior to final configuration of the HMD device. Based onthese measurements, the see-through display module and frames of the HMDdevice may be selected from a plurality of differently-sized stockcomponents to closely accommodate the user's measurements. The framesmay be additionally customized by fine adjustments and/or manufacturedfrom scratch to provide sizing points of the frames that match theuser's fit points. External componentry, such as audio components andcontrol circuits, may be coupled to the device after assembly, or may beintegrated into the frames and/or see-through display module.

FIG. 1 shows an example HMD device 10. HMD device 10 may closelyresemble an ordinary pair of eyeglasses or sunglasses, and includes amodular see-through display having a right-eye see-through display 12Aand a left-eye see-through display 12B. The modular see-through displayincludes imaging panels 14A and 14B. Imaging panel 14A is arranged infront of the right eye; imaging panel 14B is arranged in front of theleft eye. Each imaging panel may include an exit pupil configured to besubstantially aligned with a user's pupil when the HMD device is worn bythe user. Thus, imaging panel 14A includes exit pupil 13A and imagingpanel 14B includes exit pupil 13B. Each exit pupil is depicted as adashed circle.

HMD device 10 also includes a wearable mount, otherwise referred to asframe 22, which positions the imaging panels a short distance in frontof the wearer's eyes. The HMD device also includes a control sub-system16, a plurality of sensors 18, and an audio sub-system 20. The controlsub-system 16 may include a microcomputer, such as a printed circuitboard assembly or flex circuit, operatively coupled to both imagingpanels, to the sensors, and to audio sub-system 20. In the embodiment ofFIG. 1, the wearable mount takes the form of eyeglass frames.

Sensors 18 may be arranged in any suitable location in HMD device 10.They may include a gyroscope, accelerometer, or other inertial sensor, aglobal-positioning system (GPS) receiver, and/or a barometric pressuresensor configured for altimetry. These sensors may provide data on thewearer's location or orientation. From the integrated responses of thesensors, control sub-system 16 may track the movement of the HMD devicewithin the wearer's environment.

In one embodiment, sensors 18 may include an eye-tracker—i.e., a sensorconfigured to detect an ocular state of the wearer of HMD device 10. Theeye tracker may locate a line of sight of the wearer, measure an extentof iris closure, etc. If two eye trackers are included, one for eacheye, then the two may be used together to determine the wearer's focalplane based on the point of convergence of the lines of sight of thewearer's left and right eyes. This information may be used for placementof a computer-generated display image, for example.

Audio sub-system 20 may include a suitable speaker system suspendedfrom, attached separately to, or integrated directly into frame 22 inlocations configured to be near each ear of the user.

In the illustrated embodiment, each imaging panel 14 is at least partlytransparent, to provide a substantially unobstructed field of view inwhich the wearer can directly observe his physical surroundings. Eachimaging panel is configured to present, in the same field of view, acomputer-generated display image. Control sub-system 16 may control theinternal componentry of imaging panels 14A and 14B in order to form thedesired display images. In one embodiment, control sub-system 16 maycause imaging panels 14A and 14B to display the same image concurrently,so that the wearer's right and left eyes receive the same image at thesame time. In another embodiment, the imaging panels may projectsomewhat different images concurrently, so that the wearer perceives astereoscopic, i.e., three-dimensional image. In one scenario, thecomputer-generated display image and various real images of objectssighted through an imaging panel may occupy different focal planes.Accordingly, the wearer observing a real-world object may have to shifthis or her corneal focus in order to resolve the display image. In otherscenarios, the display image and at least one real image may share acommon focal plane.

In the HMD devices disclosed herein, sensors 18 may also be configuredto acquire video of the surroundings sighted by the wearer. The videomay include depth video. It may be used to establish the wearer'slocation, what the wearer sees, etc. The video acquired by the sensorsmay be received in control sub-system 16, and the control sub-system 16may be configured to process the video received. To this end, sensors 18may include a camera. The optical axis of the camera may be alignedparallel to a line of sight of the wearer of the HMD device, such thatthe camera acquires video of the external imagery sighted by the wearer.The video acquired may comprise a time-resolved sequence of images ofspatial resolution and frame rate suitable for the purposes set forthherein. As the HMD device may include two imaging panels—one for eacheye—it may also include two cameras. More generally, the nature andnumber of the cameras may differ in the various embodiments of thisdisclosure. One or more cameras may be configured to provide video fromwhich a time-resolved sequence of three-dimensional depth maps isobtained via downstream processing.

No aspect of FIG. 1 is intended to be limiting in any sense, fornumerous variants are contemplated as well. In some embodiments, forexample, a vision system integrated with imaging panels 14 may be usedto acquire video of what the wearer sees. In some embodiments, abinocular imaging panel extending over both eyes may be used instead ofthe monocular imaging panel shown in the drawings. Likewise, an HMDdevice may include a binocular eye tracker. In some embodiments, an eyetracker and imaging panel may be integrated together, and may share oneor more optics.

The HMD devices disclosed herein may be used to support avirtual-reality (VR) or augmented-reality (AR) environment for one ormore participants. A realistic AR experience may be achieved with eachAR participant viewing his environment naturally, through passive opticsof the HMD device. Computer-generated imagery, meanwhile, may beprojected into the same field of view in which the real-world imagery isreceived. Imagery from both sources may appear to share the samephysical space. Furthermore, the control sub-system in the HMD devicemay be configured to run one or more computer programs that support theVR or AR environment. In some embodiments, some computer programs mayrun on an HMD device, and others may run on an external computeraccessible to the HMD device via one or more wired or wirelesscommunication links. Accordingly, the HMD device may include suitablewireless componentry, such as Wi-Fi.

FIG. 2 illustrates a method 200 for creating a customized HMD device,such as HMD device 10, according to an embodiment of the presentdisclosure. As explained above with respect to FIG. 1, the HMD devicemay include a see-through display, a frame, and additional componentssuch as sensors and a controller. Creating an HMD device that iscustomized for a specific user may include customizing the see-throughdisplay in order to align exit pupils of the see-through display withpupils of the user, and customizing the frames to minimize movement ofthe see-through display.

Method 200 includes, at 202, obtaining a plurality of fit points and aninterpupillary distance (IPD) of a user. As will be described in moredetail below with respect to FIG. 3, the user's fit points may definemeasurements of various facial features that interact with and definehow the HMD device fits on the user. For example, the fit points mayinclude a head circumference, a location of the bridge of the nose, andlocations of each ear of the user, and the location of each pupilrelative to other fit points. The IPD is the distance between the centerpoints of the pupils of the user. The fit points and IPD of the user maybe obtained by a retail distributor of HMD devices, for example when theuser orders a customized device, or may be obtained by the user and sentto the producer of the HMD device. Additional detail regarding obtainingfit points and an IPD of a user will be presented below with respect toFIGS. 3-7.

At 204, method 200 includes selecting modular components of the HMDdevice. Each component of the HMD device may be selected from aplurality of differently-sized components to closely accommodate theuser fit points and IPD. The modular components of the HMD device mayinclude imaging panels, such as the imaging panels 14 described abovewith respect to FIG. 1, incorporated into a see-through displaysub-assembly. The see-through display sub-assembly may include aright-eye module and a left-eye module, each containing an imagingpanel, as depicted in FIG. 1. In some embodiments, the right-eye andleft-eye modules may be integrated in a single piece, or may be separateand coupled via an external component, such as a brow bar.

The modular components may further include a frame assembly, such asframe 22 of FIG. 1, which may be coupled to the see-through displaysub-assembly. The frame assembly is configured to be worn by the userand hold the see-through display in a defined position relative to theuser. For example, the frame assembly may be coupled to the see-throughdisplay sub-assembly in such a manner that exit pupils of the see-thoughdisplay are substantially aligned with the user's pupils when the HMDdevice is worn by the user. Additional modular components of the HMDdevice may include an audio sub-system, control sub-system, opticalsensors, and fit components. Additional detail regarding selectingmodular components of the HMD device will be presented below withrespect to FIGS. 8-11.

At 206, method 200 includes assembling the customized HMD device.Assembling the HMD device may include coupling the components selectedat 204 together in a desired configuration. In some embodiments,assembling the HMD device may include selecting a subset of components,such as the see-through display, that closely match the user'smeasurements, customizing the frames to provide a near-exact match tothe user's measurements, and then coupling the selected components tothe customized frames. Additional detail regarding assembling thecustomized HMD device will be provided below with respect to FIGS.12-15. At 208, the customized HMD device is delivered to the user.

Thus, method 200 of FIG. 2 provides for mass customization of HMDdevices, such that each HMD device may be sized for a specific userwhile producing the HMD devices on a large scale. In order to customizean HMD device for a specific user, fit points of the user are obtainedfrom measurements of the user's head, and the fit points utilized duringthe customization of the HMD device. FIG. 3 is a flow chart illustratinga method 300 for obtaining fit points of a user according to anembodiment of the present disclosure.

At 302, method 300 includes receiving a fit profile of a user, whichincludes a plurality of fit points and an interpupillary distance (IPD)of the user. The fit points of the user may define one or more of a headlength, a head width, a head circumference, an ear-to-eye distance, aneye-to-back of head distance, an ear-to-occipital distance of the user,and the location of each pupil relative to one or more other fit points.Additionally, the fit points may define a location of an ear of theuser, a location of a nose of the user, etc. Other user headmeasurements are within the scope of this disclosure.

An example set of fit points of a user are schematically illustrated inFIG. 4B. The set of fit points 404 are depicted as the dotted circles.The set of fit points 404 shown in FIG. 4B may include a pointcorresponding to a bridge of the user's nose, points corresponding tothe user's temples, points corresponding to the user's ears, and otherlocations. The set of fit points 404 may include virtually any number offit points. Increasing numbers of fit points may provide for moreprecise customization. While FIG. 4B depicts the fit points in twodimensions, it should be appreciated that the fit points representmeasurements of the user's head in three dimensions. However,embodiments where the fit points only represent measurements in twodimensions are also within the scope of this disclosure.

Returning to FIG. 3, receiving the IPD and plurality of fit points ofthe user may include receiving an IPD and fit points that have beenmeasured manually by the user or a helper at 304. For example, the usermay measure the fit points described above manually with a tape measureor another measurement instrument. One example measurement instrument isillustrated in FIG. 5. FIG. 5 schematically depicts a template 502 formeasuring a head 504 of a user. As shown, the template 502 includes ahead piece 506 and an eye piece 508, each having a measuring mechanism,such as a plurality of holes cut out of cardstock or other material, aplurality of inter-locking notches, etc., along with numerical values atone or more holes or inter-locking notches. The user may obtainmeasurements corresponding to each fit point by adjusting the head piece506 to closely fit around his or her head 504 and recording numericalvalues from the head piece 506 that correspond to each fit point. Forexample, a set of corresponding inter-locking notches may define theuser's head circumference, while the location of a hole (such as hole510) may define the location of the user's ear. The IPD may be obtainedby the user determining which holes of the eye piece 508 align with hisor her pupils.

The measurement instrument illustrated in FIG. 5 is one non-limitingexample of how a user's fit points and IPD may be measured manually. Inanother non-limiting example, the user could look through parallel cardsthat include horizontal and vertical slits, and determine which slitshis or her pupils align with. In an additional non-limiting example, aretail location at which the user orders a customized HMD device mayinclude a rigid mechanical armature, whether plastic or metal or somecombination, configured to obtain measurements of the user's head. Thearmature may include sliding pieces that may be adjusted until a tightfit around the user's head is obtained. The armature may further includean eye piece configured to measure the user's IPD.

While measuring the fit points of the user manually may be simple andcost-effective, it may result in relatively coarse measurements. Toobtain finer measurements, the user's head may be scanned using anelectronic scanning system. As such, returning to FIG. 3, receiving theIPD and plurality of fit points of the user may include receiving an IPDand fit points that have been automatically measured by a retailscanning system at 306. Retail locations configured to distribute HMDdevices may include a 3-D scanning system with a plurality of depthand/or visible light cameras, such as four cameras, six cameras, etc.The fit points of the user may be measured by the scanning system viaimages of the user acquired from the plurality of cameras. For example,each camera may simultaneously image a different location of the user'shead, and the scanning system may be configured to compile a 3-D imageof the user's head and identify the fit points and IPD from the 3-Dimage.

Further, in some embodiments, receiving the IPD and plurality of fitpoints of the user may include receiving fit points that have beenautomatically measured by a scanning system of the user at 308. Thescanning system of the user may include one or more depth or visiblelight cameras configured to acquire images of the user and send theimages to a computing system configured to identify the fit points andIPD of the user from the images. Additional detail regarding thescanning system of the user will be explained below with regard to FIGS.6 and 7.

Continuing with FIG. 3, at 310 method 300 includes spacing exit pupilsof a see-through display to match the IPD of the user. As explainedabove with respect to FIG. 1, the HMD device may include a see-throughdisplay with a right-eye module and a left-eye module, each of whichincludes an exit pupil. When the HMD device is assembled, the modules ofthe see-through display may be spaced apart from each other at adistance equal to the IPD of the user. At 312, a frame is customized toaccommodate the fit points of the user. The frame of the HMD device mayinclude a plurality of adjustable sizing points, and the frame may becustomized by adjusting the sizing points to closely accommodate the fitpoints of the user.

FIG. 4A shows sizing points 402 of a non-customized, generic HMD device400 as hash-marked circles. As depicted in FIG. 4B, each sizing point402 of the HMD device may not align with a corresponding fit point of auser. However, as shown in FIG. 4C, following customization of the HMDdevice 406, as will be explained in more detail in FIGS. 8-15, thesizing points 402 of the HMD device are adjusted to closely accommodate,e.g., substantially align with, the fit points 404 of the user.

Returning to FIG. 3, at 314, the see-through display is coupled to thecustomized frame. Coupling the see-through display to the customizedframe includes, at 316, assembling the head-mounted display device basedon the fit points such that exit pupils of the see-through display aresubstantially aligned with the user's pupils when the HMD device is wornby the user. As will be explained in detail below, each module of thesee-through display may be coupled to the frame via a brow bar, and maybe coupled to the brow bar at a distance equal to the IPD of the user.Further, this may include spacing each module of the see-through displayat a distance relative to the user's nose. As the user's face may not besymmetrical, the distance between the right eye and nose of the user andthe distance between the left eye and nose of the user may not be equal.Thus, the see-through display may be coupled to the frame at a distanceequal to the IPD of the user, but in positions relative to both theuser's eyes and nose.

At 318, external components are coupled to the HMD device. The externalcomponents may include one or more of an audio system, control system,sensors, and fit components.

Parts of method 300 may be carried out by one or more computing devices,such as computing system 1600, described below with respect to FIG. 16.For example, the fit points of the user may be received by a modelingmodule of a computing device that outputs a custom 3-D model of the HMDdevice including sizing points to accommodate the fit points of theuser. This 3-D model may then be utilized by a fabrication system,controlled by the same computing device or by another computing device,to fabricate one or more components of the HMD device.

In embodiments where the fit points are measured manually, the user mayinput the fit points to the modeling module, or the user may input thefit points to a remote device that may send the fit points to themodeling module. In embodiments where the fit points of the user aremeasured automatically, such as by a retail or user scanning system, thescanning system may send the fit points directly to the modeling module,or the scanning system may send the fit points to a remote device, suchas a server, and the modeling module may receive the fit points via theserver.

FIG. 6 illustrates a method 600 for obtaining a fit profile of a user.Method 600 may be carried out by a scanning system of the user, such asthe system described below with respect to FIG. 7. Method 600 includes,at 602, sending to a display device a graphical user interfaceinstructing the user to assume a particular position. For example, text,video, and/or audio prompts that instruct the user where to stand, whichdirection to face, etc., may be displayed via the display device. At604, one or more color and depth images of the user are acquired. Thescanning system may include a visible light camera and/or a depthcamera, and acquire the color and depth images from the visible lightand depth camera, respectively.

At 606, method 600 includes identifying a fit profile of the user fromthe one or more depth and color images. As explained previously, the fitprofile includes an interpupillary distance and one or more fit pointsof the user. The IPD may be identified from one or more color and depthimages acquired by the visible light and depth cameras. Identifying theIPD includes locating each of the user's pupils, which may be visible ina color image of the user, and determining the distance between thecenters of each pupil. The one or more fit points of the user may beidentified from one or more depth images acquired by the depth camera.

To ensure a high-fidelity determination of the IPD and fit points, themeasurements may be calibrated using fiducial markers at 608. Forexample, the user interface sent to the display device may optionallyprompt the user to fix a marker to his or her head prior to acquiringthe images. The marker may be of a known size and visible in both thecolor and depth images. Alternatively or additionally, visible and/or IRlight may be projected on to the user in a known location to calibratethe measurements and/or align the multiple color and depth images.

At 610, it is determined if the IPD and all desired fit points have beenidentified. If the IPD and all desired fit points have not beenidentified, method 600 returns to 602 to instruct the user to assume aparticular position. The position may be different than the firstposition the user was instructed to assume, in order to acquire imagesof a different region of the user's head. If it is determined that theIPD and all fit points have been identified, method 600 proceeds to 612to compile the fit points and IPD into a single common coordinatesystem. As the fit points and IPD may be identified from a plurality ofimages, in order to combine the fit points and IPD into a single fitprofile, each fit point and the IPD may be assigned a set of coordinatesrelative to a fixed data point. For example, the fixed data point may bethe midpoint between the user's pupils, or may be a point on thefiducial marker fixed to the user. Each fit point and center of eachpupil may be assigned an x, y, z coordinate relative to the fixed datapoint.

At 614, the fit profile is sent to a remote computing device, such as aserver or to a computing device configured to produce a model of the HMDdevice based on the fit profile.

While the embodiment depicted in FIG. 6 includes the scanning systemidentifying the fit points and IPD, in other embodiments the imagesthemselves may be sent to a remote computing device configured toidentify the fit points from the images. In other embodiments, the fitpoints and IPD may be represented by a mechanism other than the x, y, zcoordinate system. For example, the fit points may be represented by adeviation from a common fit profile (e.g., each fit point may berepresented as a difference between the measured fit point location andan average location for that fit point), or other suitable mechanism.

FIG. 7 shows a non-limiting example of a user scanning environment 700in the form of an entertainment system 702, a display device 704, andone or more sensors 706. The display device 704 may be operativelyconnected to the entertainment system 702 via a display output of theentertainment system. For example, the entertainment system may includean HDMI or other suitable display output. The display device 704 asshown in FIG. 7 is in the form of a television or a computer monitor,which may be used to present a graphical user interface to a user 708.The graphical user interface may instruct the user 708 to assume one ormore positions in order to acquire images and identify the user's fitpoint measurements and IPD from the acquired images.

FIG. 7 shows that the scanning environment 700 may be used by the user708 in order to obtain a fit profile, which may then be sent to a remotecomputing device to create a customized HMD device for the user. Asexplained above, the user's fit profile may be identified through imagesacquired by one or more sensors 706, such a visible light camera ordepth camera, that identifies, monitors, or tracks the user 708. The oneor more sensors 706 may be operatively connected to the entertainmentsystem 702 via one or more sensor inputs. As a non-limiting example, theentertainment system 702 may include a universal serial bus to which adepth camera may be connected.

In one example, after presenting instructions to the user 708 via thedisplay device 704, entertainment system 702 may acquire one or moreimages of the user's head via one or more sensors 706. The images may bedepth images taken from a depth camera, such as an infra-red (IR)camera, and/or images taken from a visible light camera, such as an RGBcamera. The user interface may instruct the user to change positions sothat images of the user's entire head are taken. The entertainmentsystem may compile all or a subset of the images into a 3-D model of theuser's head, represented on the display device as head model 710. Basedon the model, the entertainment system 702 may identify a plurality offit points and the user's IPD. For example, the color images may be usedto identify the user's IPD, while the depth images may be used toidentify the fit points of the user.

The entertainment system 702 may be configured to communicate with oneor more remote computing devices, not shown in FIG. 7, in order to sendthe fit points and IPD to a remote computing device, where they will beavailable as the user's fit profile for subsequent assembly of thecustomized HMD device.

While the embodiment depicted in FIG. 7 shows the entertainment system702, display device 704, and sensors 706 as separate elements, in someembodiments one or more of the elements may be integrated into a commondevice. For example, the entertainment system 702, display device 704,and sensor 706 may be integrated in a laptop computer, tablet computer,mobile telephone, mobile computing device, etc.

Thus, the embodiments of FIGS. 3-7 provide for obtaining a user fitprofile that may be utilized to fabricate a custom HMD device. The fitprofile may include various head measurements and the IPD of the user.Each user may not have an IPD that is proportional to his or her headsize. For example, a user may have a relatively wide IPD while having arelatively small head. To accommodate variation in IPD and head sizesamong users, the HMD devices may be assembled from modular componentssized to cover a wide range of head sizes and IPDs. Various embodimentsfor assembling customized modular HMD devices are presented below.

FIG. 8 illustrates a method 800 for assembling a modular head-mounteddisplay device customized for a user. The modular HMD device may becomprised of multiple components configured to be coupled together tocreate the HMD device. Some of the components, such as the frame andsee-through display, may be manufactured in multiple sizes, and duringthe assembly of the HMD device, the component sizes that most closelymatch the fit profile of the user are selected to be included in the HMDdevice. Additional customization may be provided by coupling a pluralityof fit components, such as nose pieces and temple pads sized for theuser, to the assembled HMD device.

At 802, method 800 includes selecting a modular see-through display.Selecting the modular see-through display includes selecting a modularsee-through display from a plurality of differently-sized see-throughdisplays at 804, in order to provide a see-through display that closelyaccommodates a user fit profile. For example, the see-through displaymay include a right-eye module and a left-eye module, each manufacturedin a plurality of sizes. Each module may be selected to closely matchthe fit points of the user. As such, selecting the modular see-throughdisplay also includes selecting the modular see-through display to matchexit pupils of the display with the pupils of the user at 806. Theselected size of the see-through display modules may be based on anIPD-to-head size relationship of the user to align the exit pupils ofthe see-through display as closely as possible with the exit pupils ofthe user. For example, the modular see-through display may be selectedsuch that exit pupils of the modular see-through display are spacedapart by a distance that matches the IPD of the user when the modularsee-through display is coupled to a modular frame. When matching theexit pupils of the see-through display with pupils of the user, the exitpupils may be substantially aligned with the user's pupils, for exampleeach exit pupil may be aligned within 4 mm of each pupil of the user,within 1 mm of each pupil, or another suitable range.

At 808, method 800 includes coupling the selected see-through display toa modular frame. Coupling the selected modular see-through display to amodular frame includes coupling the selected modular see-through displayto a modular frame that closely accommodates the user fit profile at810. Similar to selecting the see-through display, the modular frame maybe selected from a plurality of differently-sized modular frames at 812.At 814, coupling the selected modular see-through display to the modularframe includes coupling the see-through display to the frame via a browbar. The brow bar may mechanically hold the see-through display modulesat a certain distance apart (e.g., a distance equal to the IPD of theuser). The brow bar may act as the backbone of the HMD device in that itcouples the see-through display, frame assembly, and additional optionalcomponentry (such as a nose piece) together. The brow bar includes oneor more mounts for coupling to the see-through display and additionalmounts for coupling to the frame.

FIG. 9A illustrates example component sets 900 that may be utilizedduring the assembly of a modular HMD device. Modular see-through displayset 901 includes a plurality of differently-sized versions of asee-through display, each including a right-eye module 902 and aleft-eye module 903. Each right-eye module and left-eye module includesan optics pod 905 that may include one or more inward and/or outwardfacing sensors, a control module, and/or electronic interfaces. In theexample embodiment depicted, modular see-through display set 901includes a small-sized see-through display 904, medium-sized see-throughdisplay 906, and large-sized see-through display 908, from which adesired see-through display may be selected. However, any number ofversions of see-through displays is within the scope of this disclosure.

In one example, each sized-version of the see-through displays may beadjustable to cover an IPD range of 6 mm, in order to provide a totalaccommodation of 18 mm variation in IPD distances. As adult IPDstypically range from, for example, 53 mm to 70 mm, an 18 mm range mayprovide suitable coverage for nearly all adult IPDs. Thus, see-throughdisplay 904 may cover IPDs in the range of 53-58 mm, see-through display906 may cover IPDs in the range of 59-64 mm, and see-through display 908may cover IPDs in the range of 65-70 mm. However, by altering the sizeranges covered by each sized-version and/or including additionalsized-versions, other size ranges may be accommodated.

Modular frame set 910 includes a plurality of differently-sized versionsof a frame. As depicted, modular frame set 910 includes a small-sizedframe 912, medium-sized frame 914, large-sized frame 916, andextra-large-sized frame 918. However, any number of versions of framesin the modular frame set is within the scope of this disclosure. Whileeach frame version depicted in modular frame set 910 includes a nosepiece 921 attached to the frame, in some embodiments the nose pieces maybe provided separately. Further, the nose pieces, as well as other fitcomponents not illustrated in FIG. 9A, may be provided in a plurality ofdifferent sizes.

FIG. 9B illustrates the assembly of an example HMD device 920 utilizingselected modular components. A modular see-through display selected fromset 901, such as see-through display 904, is coupled to brow bar 922,which may include one or more sensors, a control module, and/orelectronic interfaces, to form a modular see-through displaysub-assembly 924. Modular see-through display 904 may be selectablycoupled to the brow bar 922 so that the exit pupils of the see-throughdisplay are spaced at a distance equal to the IPD of the user. Forexample, the brow bar 922 may include a mounting rail to which eachmodule of the see-through display is mounted. The rail may be configuredto allow infinite mounting locations or incremental mounting locations.

Modular see-through display sub-assembly 924 is then coupled to amodular frame selected from modular frame set 910, such as frame 914, toform HMD device 920. The modular see-through display sub-assembly 924may be coupled to a single location on the frame via the brow bar, ormay be coupled via multiple locations. However, regardless of the sizesof the selected see-through display and frame, the modular see-throughdisplay sub-assembly is configured to be mounted to a common location oneach frame. Further, each sized-version of the see-through display isconfigured to be mounted to any-sized version of the frame, i.e., ifthree differently-sized versions of the see-through display and fourdifferently-sized versions of the frames are provided, twelve HMD deviceconfigurations are possible. However, near infinite variations withineach configuration may be possible due to variable spacing provided bythe brow bar.

Returning to FIG. 8, after coupling the see-through display to theframe, method 800 optionally includes coupling an audio sub-system tothe frame at 816. In some embodiments, the audio sub-system may beprovided separately from the frame and coupled to the frame as anexternal component. However, in other embodiments, the audio system maybe integrated into the frame, and thus is not coupled to the frameseparately.

At 818, method 800 includes optionally coupling a control sub-system tothe frame. Similar to the audio sub-system, the control sub-system mayalready be integrated in the frames, or may be coupled as a separatecomponent. In other embodiments, the control sub-system may beintegrated in the see-through display, or integrated in the brow bar.

At 820, a shield may be optionally coupled to the see-through display orframe. The shield may protect the see-through display from movement anddegradation as well as provide cosmetic detail to the HMD device, anddepending on the desired configuration, may be coupled to thesee-through display directly, or may be coupled to the frame or browbar. Further, in some embodiments, the shield may be integrated with thesee-through display.

At 822, a plurality of fit components are optionally coupled to theframe. The fit components may include a nose piece, temple pads,forehead pads, and other fit features. These fit components may beavailable in a variety of shapes, textures, materials, and finishes toprovide fine tuning of the final fit of the HMD device.

Method 800 allows for selection of differently sized modular componentswhich may be assembled to form a customized HMD device. The modularcomponents are designed in such a manner that any size of each modularcomponent may be coupled with any size of the other modular components.For example, a plurality of differently-sized see-through displaysub-assemblies may be provided. Each see-through display sub-assemblymay include a see-through display and a brow bar coupled to thesee-through display. The brow bar may include one or more mountings at acommon mount location. As used herein “common mount location” refers toa mount location that is at a common location on each brow bar,regardless of the size of the brow bar.

Each brow bar may be configured to be mounted to any size of a pluralityof differently-sized frames via the one or more mountings of the browbar to one or more mount points of the frames. Thus, the brow bar andframe may be coupled to each other at the same location for each HMDdevice that is assembled. This is accomplished by each of thedifferently-sized frames having the same mount points to fit the commonmount location of the brow bar. Further, the see-through displaysub-assembly is configured to be mounted to any frame of the pluralityof differently-sized frames in the same location on each frame, and anaudio subsystem may be configured to be mounted to any sized frame ofthe plurality of differently-sized frames.

As explained above with respect to method 800 of FIG. 8, the assembly ofthe modular HMD device involves coupling various modular componentstogether to create a final HMD device. The components include one ormore of a see-through display sub-assembly (including brow bar), frame,audio sub-system, control sub-system, and fit components. Further, eachcomponent may be manufactured separately and coupled together duringassembly. However, in some embodiments, one or more of the componentsmay be integrated during manufacture. FIG. 10 illustrates an example“menu” 1000 of possible components that may be selected from duringassembly of a modular HMD device. While a single size is illustrated foreach different modular component, it is to be understood that each suchcomponent have a plurality of different sizes.

Menu 1000 may include multiple see-through display configurations.See-through display configuration 1002 includes a right-eye module,left-eye module, brow bar, and optics pods. The optics pods may includethe optical sensors, cameras, and other components to present images tothe user, track user eye movement, and perform other optical tasks.See-through display configuration 1004 includes all the components ofconfiguration 1002 plus a control assembly and audio assembly coupled tothe brow bar and/or see-through display modules.

Menu 1000 may also include multiple frame configurations. The frame maybe a single piece or may be comprised of one or more of a front bridge,left temple arm, and right temple arm. Frame configuration 1006 includesa front bridge and right and left temple arms. The left and right templearms of frame configuration 1006 include bumpers to protect the opticspods of the see-through display. Frame configuration 1008 includes afront bridge and right and left temple arms, similar to frameconfiguration 1006. However, the right and left temple arms of frameconfiguration 1008 do not include bumpers.

Frame configurations 1010 and 1012 each include only right and lefttemple arms, with the temple arms of 1010 including bumpers while thetemple arms of 1012 do not include bumpers. Frame configuration 1014 andframe configuration 1016 each include right and left temple arms coupledto a control system and an audio system. The temple arms of frameconfiguration 1014 include protective bumpers.

Menu 1000 also includes additional component configurations separatefrom a frame or see-through display configuration. Componentconfiguration 1018 includes a control system and an audio system.Component configurations 1020 and 1022 each include a shield to coverand protect a see-through display. The shield of component configuration1020 includes protective bumpers to protect the optics pods of thesee-through display while the shield of component configuration 1022does not include bumpers.

No aspect of FIG. 10 is intended to be limiting in any sense, fornumerous variants are contemplated as well. In some embodiments, forexample, each of the audio sub-system and the control sub-system may beprovided as a separate component. In other embodiments, the nose pieceand other fit components may each be provided as a separate component,or may be integrated with the frame, brow bar, or other components.

Thus, when assembling a modular HMD device, subsets of the above orother components may be selected and coupled together. FIG. 11 is anexample modular HMD device 1100 assembled utilizing components selectedfrom menu 1000 of FIG. 10. Modular HMD device 1100 includes frameconfiguration 1006, which includes right and left temple arms withbumpers and a front bridge integrated as a single component. Frameconfiguration 1006 is coupled to see-through display configuration 1002via the brow bar of see-through display configuration 1002. The controland audio systems are provided via component configuration 1018 (whichalso includes a nose piece). The component configuration 1018 may becoupled to the brow bar and/or to the frame configuration 1006 (forexample, the audio system may be coupled to the temple arms of theframe). Finally, a shield is provided via component configuration 1022to protect the see-through display. Additional components not shown,such as temple pads, may also be coupled to HMD device 1100.

The example HMD device 1100 presented in FIG. 11 is one non-limitingexample of how selected components from menu 1000 of FIG. 10 may beassembled to form an HMD device. In another non-limiting example, frameconfiguration 1016 may be coupled to see-through display configuration1002 and component configuration 1020. In this example, the controlsub-system and audio sub-system are integrated into the frame, and theshield provides protection for the optics pods of the see-throughdisplay.

In another non-limiting example, see-through display configuration 1004may be coupled to frame configuration 1006, with component configuration1020. In this example, the control sub-system and audio sub-system areintegrated with the see-through display. Doing so provides for a simpleframe assembly without built-in electronics. In such circumstances, athird-party frame manufacturer may fabricate the frames according to a“hardware developer's kit,” which specifies assembly features, fit pointdimensions, and electrical specifications (for accommodating electricalconnections between components) of the frames. The see-through display,including optics pods and brow bar, control sub-system, and optionallythe audio sub-system, may be coupled to the frames at a later step toform the HMD device.

Thus, the embodiments depicted in FIGS. 8-11 provide for a modular HMDdevice including a modular frame assembly and a modular see-throughdisplay sub-assembly. The frame assembly may include one or moredifferent components, each of the different components selected from acomponent set. The component set may include at least two or moredifferently-sized versions of each different component. For example, theframe assembly may include a front bridge and a right and left templearm. Each of the front bridge, right temple arm, and left temple arm maybe selected from a respective component set to provide as close a matchas possible to the user's fit points.

The modular see-through display sub-assembly may comprise a see-throughdisplay, a plurality of optical sensors, and a brow bar. The modularsee-through display sub-assembly may include one or more mountings forselectably coupling the modular see-through display sub-assembly to themodular frame assembly. Similar to the frame assembly, the modularsee-through display sub-assembly may include one or more differentcomponents, each of the different components selected from a componentset including at least two or more differently-sized versions of eachdifferent component.

The modular see-through sub-assembly may be coupled to the modular frameassembly via the brow bar. The brow bar may be coupled to the mountingsof the see-through display sub-assembly. The modular see-through displaysub-assembly may be configured to couple to any combination ofdifferently-sized versions of each different component of the modularframe assembly, in order to provide a customized HMD device sized to aparticular user.

Further, as explained previously, additional components may be coupledto the see-through display and/or frame, including an audio system,control system, and fit components. The fit components may be selectedfrom a variety of shapes and sizes to finalize the fit of the HMD deviceto the user. However, in some embodiments, to provide even higherprecision customization, the frame assembly may be fabricated using ahigh-volume method of assembly to produce a customized frame for eachuser of a plurality of users. Embodiments for customizing the frame willbe presented below.

FIG. 12 illustrates a high-volume method 1200 of assembling a customizedaugmented reality device, such as an HMD device. Method 1200 includes,at 1202, receiving a fit profile of a first user. As explainedpreviously, the fit profile of the user includes an IPD and a pluralityof fit points of the user. At 1204, method 1200 includes creating acustomized frame to match the fit profile of the first user.

Creating the customized frame may be carried out according to a varietyof different embodiments. In one example, creating the customized frameincludes, at 1206, selecting a stock frame and adjusting the stock frameto create a modified frame that matches the fit profile. The stock framemay be selected from a set of different frame sizes, and the selectedstock frame may be a size that is a closer match to the fit profile thanother frame sizes in the set. The stock frame may be adjusted manuallyor robotically at one or more adjustable sizing points to create themodified frame. The modified frame may provide a closer match to the fitprofile than the stock frame. Additional detail regarding selecting astock frame and adjusting the stock frame to create a modified framewill be presented below with respect to FIGS. 13-15.

In another example, creating a customized frame includes, at 1208,custom fabricating the frame to match the fit profile. The entire framemay be built as one or more pieces that are custom-shaped to the user,for example by using a rapid prototyping process.

At 1210, a see-through display is coupled to the customized frame. Thesee-through display may be a see-through display sub-assembly thatincludes a brow bar, optics components (such as optical sensors), andmounts to couple the sub-assembly to the frame. The see-though displaymay be selected from a plurality of differently-sized see-throughdisplays to space exit pupils of the see-through display equal to theIPD of the first user, similar to the modular assembly embodimentdescribed above with respect to FIG. 8.

At 1212, external components may be coupled to the customized frame. Asexplained previously, the external components may include one or more ofan audio system, control system, and fit components.

Method 1200 may be repeated for each additional user fit profile. Forexample, method 1200 may be repeated for a second user. The IPD and/orplurality of fit points of the second user may be different than the IPDand plurality of fit points of the first user, and hence the frame ofthe second user may be customized to be a different size than the frameof the first user. Further, the see-through display selected for thesecond user may be of a different size than the see-through displayselected for the first user.

Both the HMD device assembled for the first user and the HMD deviceassembled for the second user may include a set of mountings. Forexample, the first see-through display may be coupled to the firstcustomized frame via a first set of mountings, and the secondsee-through display may be coupled to the second customized frame via asecond set of mountings. The first set of mountings may be positioned ata first location on the first frame and the second set of mountings maybe positioned at a second location on the second frame, with the firstand second locations having identical relative positions. In this way,any see-through display may be coupled to any sized frame in a commonlocation.

FIG. 13 schematically shows an HMD device 1300 including a modularsee-through display 1302 and a customized frame 1304 according to anembodiment of the present disclosure. The HMD device 1300 includes achassis-style frame 1304 comprised of metal or plastic, for example. Theframe 1304 includes sections that may slide, pivot, or otherwise bemanually adjusted relative to other components. For example, theportions of the frame configured to rest adjacent to a user's temples(e.g., temple arms) may include telescoping rails that allow the lengthof the temple arms to be adjusted. During customization and assembly ofthe HMD device 1300, the frame 1304 may be adjusted to accommodate thefit points of a user.

The frame 1304 also includes fixed and/or adjustable mounting features(e.g., sliding rails, tabs, slots) to which a see-through displaysub-assembly may be mounted. Additional features, such as a nose piece1306, temple pads 1308, brow bar 1310, etc., may be coupled to the frame1304. After each component has been coupled to the frame, an elasticskin 1312 may be stretched over the frame and components (while leavingthe see-through display exposed). The skin 1312 may be comprised offabric or pre-formed elastomer. The skin 1312 may be attached to theframe at fixed points, or may be attached via a continuous method suchas a snap-fit rail. While FIG. 13 illustrates the skin 1312 beingattached as the final step in assembling the HMD device 1300 (after eachcomponent has been coupled to the frame), in some embodiments, the skin1312 may be attached prior to the coupling of some or all of thecomponents.

FIG. 14 schematically shows an HMD device 1400 including a modularsee-through display 1402 and a customized frame 1404 according toanother embodiment of the present disclosure. Frame 1404 may be selectedfrom a plurality of differently-sized stock frames and adjusted tocreate a modified frame to accommodate a user's fit points. In oneexample, frame 1404 may include an armature fabricated from a formablematerial such as spring steel, titanium, or other suitable material. Thearmature may be manufactured as a single piece or as multiple piecescoupled together. A flexible elastomeric material may be injectionmolded over the armature. Following the injection molding, the frame1404 may be robotically adjusted at one or more sizing points of theframe to closely accommodate the fit points of the user, includingallowances for spring-back after adjusting. Referring back to FIGS.4A-4C, the sizing points on the non-customized frame depicted in FIG. 4Amay be robotically adjusted in order to customize the frame to match theuser fit points and produce the customized frame of FIG. 4C. Continuingwith FIG. 14, once frame 1404 has been robotically adjusted and allowedto cool or otherwise take a positional set, the see-through display 1402and additional components are coupled to the frame 1404 to form the HMDdevice 1400.

In another example, frame 1404 may be comprised of only a moldedthermoplastic material. Frame 1404 may be molded to a stock size androbotically adjusted after molding at one or more sizing points toclosely accommodate the fit points of the user, including allowances forspring-back after adjusting. Once frame 1404 has been roboticallyadjusted and allowed to cool/set, the see-through display 1402 andadditional components are coupled to the frame 1404.

FIG. 15 schematically shows an HMD device 1500 including a modularsee-through display 1502 and a customized frame 1504 according toanother embodiment of the present disclosure. Frame 1504 is a lens thatis configured to substantially encircle a head of the user. Frame 1504may be selected from a plurality of stock frames produced at high volumeby injection molding, thermoforming and CNC trimming, or other suchprocesses. Frame 1504 may then by adjusted to create a modified frame toaccommodate the user's fit points. The frame 1504 may be adjusted byheating and then formed robotically or manually to fit the user's head.The see-through display 1502 and other components may then be coupled tothe inside of frame 1504 to form HMD device 1500. Due to the increasedamount of curvature provided by frame 1504, the mechanism in which thecomponents are mounted to frame 1504 may compensate for additional gapsor other issues presented by the curvature. For example, the componentsmay be coupled to frame 1504 via an adhesive configured to expand andthus hold the components in a desired location while filling in any gapsbetween the components and frame 1504.

In some embodiments, the above described methods and processes may betied to a computing system including one or more computers. Inparticular, such methods and processes may be implemented as a computerapplication or service, an application-programming interface (API), alibrary, and/or other computer-program product.

FIG. 16 schematically shows a nonlimiting embodiment of a computingsystem 1600 that can perform one or more of the methods and processesdescribed above. Computing system 1600 may be included as part of an HMDdevice, such as HMD device 10. Computing system 1600 is one non-limitingexample of entertainment system 702. Further, computing system 1600 maybe configured to obtain fit points of a user, receive a fit profile ofthe user, produce a 3-D model of an HMD device customized for the user,and/or control fabrication, assembly, and/or customization of thecomponents of the HMD device. Computing system 1600 is shown insimplified form. It is to be understood that virtually any computerarchitecture may be used without departing from the scope of thisdisclosure. In different embodiments, computing system 1600 may take theform of a mainframe computer, server computer, desktop computer, laptopcomputer, tablet computer, home entertainment computer, networkcomputing device, gaming device, mobile computing device, mobilecommunication device (e.g., smart phone), etc.

Computing system 1600 includes a logic subsystem 1602 and a storagesubsystem 1604. Computing system 1600 may optionally include a displaysubsystem 1606, input-device subsystem 1612, communication subsystem1608, and/or other components not shown in FIG. 16. Computing system1600 may also optionally include or interface with one or moreuser-input devices such as a keyboard, mouse, game controller, camera,microphone, and/or touch screen, for example. Such user-input devicesmay form part of input-device subsystem 1612 or may interface withinput-device subsystem 1612.

Logic subsystem 1602 includes one or more physical devices configured toexecute instructions. For example, the logic subsystem may be configuredto execute instructions that are part of one or more applications,services, programs, routines, libraries, objects, components, datastructures, or other logical constructs. Such instructions may beimplemented to perform a task, implement a data type, transform thestate of one or more components, or otherwise arrive at a desiredresult.

The logic subsystem may include one or more processors configured toexecute software instructions. Additionally or alternatively, the logicsubsystem may include one or more hardware or firmware logic machinesconfigured to execute hardware or firmware instructions. The processorsof the logic subsystem may be single-core or multi-core, and theprograms executed thereon may be configured for sequential, parallel ordistributed processing. The logic subsystem may optionally includeindividual components that are distributed among two or more devices,which can be remotely located and/or configured for coordinatedprocessing. Aspects of the logic subsystem may be virtualized andexecuted by remotely accessible networked computing devices configuredin a cloud-computing configuration.

Storage subsystem 1604 includes one or more physical, non-transitory,devices configured to hold data and/or instructions executable by thelogic subsystem to implement the herein-described methods and processes.When such methods and processes are implemented, the state of storagesubsystem 1604 may be transformed—e.g., to hold different data.

Storage subsystem 1604 may include removable media and/or built-indevices. Storage subsystem 1604 may include optical memory devices(e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memorydevices (e.g., RAM, EPROM, EEPROM, etc.) and/or magnetic memory devices(e.g., hard disk drive, floppy disk drive, tape drive, MRAM, etc.),among others. Storage subsystem 1604 may include volatile, nonvolatile,dynamic, static, read/write, read-only, random access, sequentialaccess, location-addressable, file-addressable, and/orcontent-addressable devices. In some embodiments, logic subsystem 1602and storage subsystem 1604 may be integrated into one or more unitarydevices, such as an application-specific integrated circuit (ASIC), or asystem-on-a-chip.

It will be appreciated that storage subsystem 1604 includes one or morephysical, non-transitory devices. However, in some embodiments, aspectsof the instructions described herein may be propagated in a transitoryfashion by a pure signal (e.g., an electromagnetic signal, an opticalsignal, etc.) that is not held by a physical device for at least afinite duration. Furthermore, data and/or other forms of informationpertaining to the present disclosure may be propagated by a pure signal.

The terms “module,” “program,” and “engine” may be used to describe anaspect of computing system 1600 that is implemented to perform aparticular function. In some cases, such a module, program, or enginemay be instantiated via logic subsystem 1602 executing instructions heldby storage subsystem 1604. It will be understood that different modules,programs, and/or engines may be instantiated from the same application,service, code block, object, library, routine, API, function, etc.Likewise, the same module, program, and/or engine may be instantiated bydifferent applications, services, code blocks, objects, routines, APIs,functions, etc. The terms “module,” “program,” and “engine” mayencompass individual or groups of executable files, data files,libraries, drivers, scripts, database records, etc.

It is to be appreciated that a “service”, as used herein, is anapplication program executable across multiple user sessions. A servicemay be available to one or more system components, programs, and/orother services. In some implementations, a service may run on one ormore server-computing devices.

When included, display subsystem 1606 may be used to present a visualrepresentation of data held by storage subsystem 1604. This visualrepresentation may take the form of a graphical user interface (GUI). Asthe herein described methods and processes change the data held by thestorage subsystem, and thus transform the state of the storagesubsystem, the state of display subsystem 1606 may likewise betransformed to visually represent changes in the underlying data.Display subsystem 1606 may include one or more display devices utilizingvirtually any type of technology. Such display devices may be combinedwith logic subsystem 1602 and/or storage subsystem 1604 in a sharedenclosure, or such display devices may be peripheral display devices.

When included, communication subsystem 1608 may be configured tocommunicatively couple computing system 1600 with one or more othercomputing devices. Communication subsystem 1608 may include wired and/orwireless communication devices compatible with one or more differentcommunication protocols. As nonlimiting examples, the communicationsubsystem may be configured for communication via a wireless telephonenetwork, or a wired or wireless local- or wide-area network. In someembodiments, the communication subsystem may allow computing system 1600to send and/or receive messages to and/or from other devices via anetwork such as the Internet.

Sensor subsystem 1610 may include one or more sensors configured tosense different physical phenomenon (e.g., visible light, infraredlight, acceleration, orientation, position, etc.), as described above.For example, the sensor subsystem 1610 may comprise one or more imagesensors, motion sensors such as accelerometers, touch pads, touchscreens, and/or any other suitable sensors. Therefore, sensor subsystem1610 may be configured to provide observation information to logicsubsystem 1602, for example. As described above, observation informationsuch as image data, motion sensor data, and/or any other suitable sensordata may be used to perform such tasks as determining a particulargesture performed by the one or more human subjects.

In some embodiments, sensor subsystem 1610 may include a depth camera(e.g., sensor 18 of FIG. 1 or sensor 706 of FIG. 7). The depth cameramay include left and right cameras of a stereoscopic vision system, forexample. Time-resolved images from both cameras may be registered toeach other and combined to yield depth-resolved video.

In other embodiments, the depth camera may be a structured light depthcamera configured to project a structured infrared illuminationcomprising numerous, discrete features (e.g., lines or dots). The depthcamera may be configured to image the structured illumination reflectedfrom a scene onto which the structured illumination is projected. Basedon the spacings between adjacent features in the various regions of theimaged scene, a depth image of the scene may be constructed.

In other embodiments, the depth camera may be a time-of-flight cameraconfigured to project a pulsed infrared illumination onto the scene. Thedepth camera may include two cameras configured to detect the pulsedillumination reflected from the scene. Both cameras may include anelectronic shutter synchronized to the pulsed illumination, but theintegration times for the cameras may differ, such that a pixel-resolvedtime-of-flight of the pulsed illumination, from the source to the sceneand then to the cameras, is discernable from the relative amounts oflight received in corresponding pixels of the two cameras.

In some embodiments, sensor subsystem 1610 may include a visible lightcamera. Virtually any type of digital camera technology may be usedwithout departing from the scope of this disclosure. As a non-limitingexample, the visible light camera may include a charge coupled deviceimage sensor.

It will be understood that the configurations and/or approachesdescribed herein are exemplary in nature, and that these specificembodiments or examples are not to be considered in a limiting sense,because numerous variations are possible. The specific routines ormethods described herein may represent one or more of any number ofprocessing strategies. As such, various acts illustrated and/ordescribed may be performed in the sequence illustrated and/or described,in other sequences, in parallel, or omitted. Likewise, the order of theabove-described processes may be changed.

The subject matter of the present disclosure includes all novel andnonobvious combinations and subcombinations of the various processes,systems and configurations, and other features, functions, acts, and/orproperties disclosed herein, as well as any and all equivalents thereof.

The invention claimed is:
 1. A head-mounted display device, comprising:a modular frame assembly including one or more different components,each of the different components selected from a component set, thecomponent set including at least two or more differently-sized versionsof each different component; and a modular see-through displaysub-assembly including one or more mountings for selectably coupling themodular see-through display sub-assembly to the modular frame assembly,the modular see-through display sub-assembly configured to couple to anycombination of differently-sized versions of different components of themodular frame assembly.
 2. The head-mounted display device of claim 1,wherein the modular see-through sub-assembly is coupled to the modularframe assembly via a brow bar, the brow bar coupled to the mountings ofthe see-through display sub-assembly.
 3. The head-mounted display deviceof claim 1, wherein the modular see-through display assembly is coupledto the modular frame assembly such that exit pupils of the modularsee-through display assembly are aligned with pupils of a user when thehead-mounted display device is worn by the user.
 4. The head-mounteddisplay device of claim 1, wherein the modular see-through displaysub-assembly includes a see-through display and a plurality of opticalsensors.
 5. The head-mounted display device of claim 4, wherein thesee-through display comprises a right-eye module and a left-eye module.6. The head-mounted display device of claim 1, further comprising acontrol subsystem coupled to the modular frame assembly.
 7. Thehead-mounted display device of claim 1, further comprising a controlsubsystem coupled to the modular see-through display sub-assembly. 8.The head-mounted display device of claim 1, further comprising an audiosubsystem coupled to the modular frame assembly.
 9. The head-mounteddisplay device of claim 1, further comprising a plurality of fitcomponents coupled to the modular frame assembly.
 10. The head-mounteddisplay device of claim 9, wherein the plurality of fit componentscomprise a nose pad, a right temple pad and a left temple pad.
 11. Thehead-mounted display device of claim 1, wherein the modular see-throughdisplay sub-assembly is selected from a plurality of differently-sizedmodular see-through display sub-assemblies.
 12. A modular component setfor a head-mounted display device, comprising: a plurality ofdifferently-sized see-through display sub-assemblies, each see-throughdisplay sub-assembly including: a see-through display; and a brow barcoupled to the see-through display and including one or more mountingsat a common mount location, each brow bar configured to be mounted toany size of a plurality of differently-sized frames via the one or moremountings of the brow bar.
 13. The modular component set of claim 12,further comprising an audio subsystem configured to be mounted to anysize of the plurality of differently-sized frames.
 14. The modularcomponent set of claim 12, wherein each see-through display sub-assemblyfurther comprises a plurality of optical sensors.
 15. The modularcomponent set of claim 12, wherein each brow bar is configured to bemounted to any size of the plurality differently-sized frames at acommon location on each frame.
 16. A method for customizing ahead-mounted display device, comprising: selecting a modular see-throughdisplay that closely accommodates a user fit profile, the modularsee-through display selected from a plurality of differently-sizedmodular see-through displays; and coupling the selected modularsee-through display to a modular frame that closely accommodates theuser fit profile, the modular frame selected from a plurality ofdifferently-sized modular frames.
 17. The method of claim 16, whereincoupling the selected modular see-through display to the modular framefurther comprises coupling the selected modular see-through display to abrow bar and mounting the brow bar to the modular frame.
 18. The methodof claim 16, further comprising coupling an audio subsystem to themodular frame.
 19. The method of claim 16, further comprising couplingone or more fit components to the modular frame.
 20. The method of claim16, wherein the fit profile of the user comprises an interpupillarydistance and one or more fit points, and wherein selecting the modularsee-through display that closely accommodates the user fit profilefurther comprises selecting the modular see-through display such thatexit pupils of the modular see-through display are spaced apart by adistance equal to the interpupillary distance when the modularsee-through display is coupled to the modular frame.